Display of information related to audio content based on ambient lighting conditions

ABSTRACT

A head-mounted device includes a first image capturing device, a transparent display, and circuitry. The first image capturing device captures an image of a scene in a line-of-sight (LOS) of a wearer of the head-mounted device. The circuitry receives an audio segment that corresponds to audio content. The circuitry determines a level of each image characteristic of a background portion and a foreground portion of the captured image. The circuitry estimates a first region on a display portion of the transparent display for display of text information associated with the received audio segment. The circuitry determines a level of each display characteristic from a set of display characteristics for the text information based on the estimated first region and the determined level of each image characteristic. The circuitry controls the display of the text information in the estimated first region of the display portion of the transparent display.

CROSS-REFERENCE TO RELATED APPLICATIONS/INCORPORATION BY REFERENCE

None.

FIELD

Various embodiments of the disclosure relate to audio reproductiontechnologies. More specifically, various embodiments of the disclosurerelate to an apparatus and method for display of information related toaudio content based on ambient lighting conditions.

BACKGROUND

Advancements in the field of audio-video (AV) content reproduction haveled to an increase in utilization of different display technologies todisplay the AV content. One of such display technologies is atransparent display or see-through display in different wearable devices(for example, head-mounted display or smart glasses. In certainconventional techniques, the AV content is rendered along with closedcaption information (or subtitles) associated with the rendered AVcontent. Such closed caption information (for example lyrics of audiocontent) may enhance user experience in understanding of the rendered AVcontent. In certain situations, when the closed caption information isdisplayed on the transparent display of the wearable devices, differentambient lighting conditions around the wearable device may influencedisplay characteristics (such as brightness, contrast, color) of thedisplayed closed caption information which may be undesirable to awearer of the wearable device. In certain conventional techniques, thedisplayed closed caption information also obscure visible objects in thedisplayed AV content, which may be not visually pleasing to a viewer ofthe AV content. Thus, an advanced and intelligent system may be desiredto dynamically control the display of the closed caption information onthe wearable devices and provide an enhanced content reproductionexperience to the wearer.

Further limitations and disadvantages of conventional and traditionalapproaches will become apparent to one of skill in the art, throughcomparison of described systems with some aspects of the presentdisclosure, as set forth in the remainder of the present application andwith reference to the drawings.

SUMMARY

An apparatus and method for display of information related to audiocontent based on ambient lighting conditions is provided substantiallyas shown in, and/or described in connection with, at least one of thefigures, as set forth more completely in the claims.

These and other features and advantages of the present disclosure may beappreciated from a review of the following detailed description of thepresent disclosure, along with the accompanying figures in which likereference numerals refer to like parts throughout.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram that illustrates an exemplary networkenvironment for display of information related to audio content based onambient lighting conditions, in accordance with an embodiment of thedisclosure.

FIG. 2 is a block diagram that illustrates an exemplary head-mounteddevice for display of information related to audio content based onambient lighting conditions, in accordance with an embodiment of thedisclosure.

FIG. 3A illustrates an exemplary scenario of a head-mounted device wornby a wearer to view a scene, in accordance with an embodiment of thedisclosure.

FIG. 3B illustrates a side view of an exemplary head-mounted device, inaccordance with an embodiment of the disclosure.

FIG. 4 illustrates an exemplary scenario which depicts a plurality ofimages captured by an image capturing device of the head-mounted device,in accordance with an embodiment of the disclosure.

FIGS. 5A and 5B collectively illustrate an exemplary scenario fordisplay of information related to audio content in a live event based onambient lighting conditions, in accordance with an embodiment of thedisclosure.

FIGS. 6A and 6B collectively illustrate a plurality of image regions ofan image captured by an image capturing device of the head-mounteddevice, in accordance with an embodiment of the disclosure.

FIGS. 7A and 7B collectively illustrate an exemplary scenario fordisplay of information related to audio content based on ambientlighting conditions associated with an enhanced view of an object in acaptured image, in accordance with an embodiment of the disclosure.

FIG. 8 depicts a flowchart that illustrates exemplary operations fordisplay of information related to audio content based on ambientlighting conditions, in accordance with an embodiment of the disclosure.

DETAILED DESCRIPTION

The following described implementations may be found in the disclosedapparatus and method for display of information related to audio contentbased on ambient lighting conditions. Exemplary aspects of thedisclosure provide a head-mounted device that dynamically controls thedisplay of closed caption information based on the ambient lightingconditions around the head-mounted device to provide enhanced visibilityand readability of the closed caption information to a wearer of thehead-mounted device. The head-mounted device may include a transparentdisplay and a first image capturing device. The head-mounted device mayfurther include circuitry coupled to the transparent display and thefirst image capturing device. The first image capturing device may beconfigured to capture an image of a scene in a line-of-sight (LOS) of awearer of the head-mounted device. Alternatively stated, the first imagecapturing device may be configured to capture the image of the scenewhich the wearer may be currently viewing.

The head-mounted device may be configured to determine a level of eachimage characteristic from a plurality of image characteristics of abackground portion and a foreground portion of the captured image. Theimage characteristics may correspond to ambient lighting conditions. Forexample, the plurality of image characteristics may include abrightness, a contrast, a background color, a foreground color, asaturation, a hue, and a gamma parameter and the like. The head-mounteddevice may be further configured to estimate a region on a displayportion of the transparent display for display of text information (e.g.closed caption information) associated with an audio segment. Thehead-mounted device may be further configured to determine a level ofeach display characteristic from a set of display characteristics (suchas foreground color, a background color, a contrast, and a brightness)for the text information based on the estimated region and thedetermined level of each image characteristic. The head-mounted devicemay be further configured to control the display of the text informationin the estimated region of the display portion, based on the determinedlevel of each display characteristic. Therefore, the wearer of thehead-mounted device may be able to view the text information for thereceived audio segment, based on the scene (or the ambient lightingconditions) in the LOS of the wearer such that the displayed textinformation is clearly readable by the wearer of the head-mounteddevice. Further, the head-mounted device may be configured to control adisplay position of the text information on the transparent displaybased on estimation of brightness level for each region on thetransparent display such that the displayed text information does notobscure a region-of-interest of the wearer or the displayed AV contentwith which the text information may be associated. Therefore, thehead-mounted device dynamically controls the display of the textinformation associated with the received audio content to provide anenhanced content reproduction experience to the wearer.

FIG. 1 is a block diagram that illustrates an exemplary networkenvironment for display of information related to audio content based onambient lighting conditions, in accordance with an embodiment of thedisclosure. With reference to FIG. 1, there is shown a networkenvironment 100, which may include a head-mounted device 102, a firstimage capturing device 104, a transparent display 106, a server 108, anda communication network 110. The head-mounted device 102 may include thefirst image capturing device 104 and the transparent display 106. Thereis further shown a wearer 114 who may be associated with thehead-mounted device 102. The head-mounted device 102 may becommunicatively coupled to the server 108 via the communication network110. In FIG. 1, there is further shown a first scene 112. The firstimage capturing device 104 may be configured to capture a plurality ofimages of the first scene 112. The first scene 112 may include aplurality of objects.

The head-mounted device 102 may comprise suitable logic, circuitry, andinterfaces that may be configured to receive an audio segment thatcorresponds to audio content. Examples of the audio content may include,but are not limited to, a song, a musical tone, a musical clip, or like.The head-mounted device 102 may be configured to receive the audiosegment from an audio capturing device situated in a live event as thefirst scene 112. In some embodiments, the audio segment may be receivedfrom the server 108 or an internal memory (not shown). The head-mounteddevice 102 may be further configured to receive an image captured by thefirst image capturing device 104. The head-mounted device 102 may beconfigured to determine a level of each image characteristic from aplurality of image characteristics of a background portion and aforeground portion of the captured image. The head-mounted device 102may be further configured to control display of text information (i.e.closed caption information) associated with the received audio segmenton the transparent display 106 based on the determined level of eachimage characteristic. In accordance with an embodiment, the head-mounteddevice 102 may be a wearable device. Examples of the head-mounted device102 may include, but are not limited to, a smart glass, a VirtualReality (VR)-based head-mounted device, an Augmented Reality (AR)-basedhead-mounted device.

The first image capturing device 104 may comprise suitable logic,circuitry, and interfaces that may be configured to capture theplurality of images of the first scene 112 in a line-of-sight (LOS) ofthe wearer 114 of the head-mounted device 102. Examples of the firstimage capturing device 104 may include, but are not limited to, acamera, an image sensor, an action camera, a closed-circuit television(CCTV) camera, a camcorder, a night-vision camera and/or other imagecapturing devices.

The transparent display 106 may comprise suitable logic, circuitry, andinterfaces that may be configured to display the text informationassociated with the received audio segment. In some embodiments, thetransparent display 106 may be configured to display the audio-video(AV) content which includes the audio content. In some embodiments, thetransparent display 106 may be configured to display the textinformation associated with the audio-video content. The transparentdisplay 106 may be a see-through display. The wearer 114 may be able tosee-through the transparent display 106 to view the first scene 112 inthe LOS of the wearer 114. In some embodiments, the transparent display106 may be a touch screen, which may enable the wearer 114 to provideinput to the head-mounted device 102 via the transparent display 106.The transparent display 106 may be realized through several knowntechnologies such as, but not limited to, at least one of a see-throughLiquid Crystal Display (LCD) display, a see-through Light Emitting Diode(LED) display, or a see-through Organic LED (OLED) display technology,or other see-through displays. In accordance with an embodiment, thetransparent display 106 may refer to, but not limited to, a displayscreen of a head-mounted device, a smart-glass device, a see-throughdisplay, a projection-based display, an electro-chromic display, or atransparent display.

The server 108 may comprise suitable logic, circuitry, and interfacesthat may be configured to store the audio content or the audio-videocontent. The server 108 may be configured to receive a request for theaudio content or the or the audio-video content from the head-mounteddevice 102. The server 108 may be further configured to transmit theaudio content or the audio-video content to the head-mounted device 102based on the received request. In accordance with an embodiment, theserver 108 may be further configured to receive and store the pluralityof images captured by the first image capturing device 104. The server108 may be further configured to store the text information (for exampleclosed caption information or lyrics information) associated with theaudio content. Examples of the server 108 may include, but are notlimited to a database server, a file server, a web server, a cloudserver, an application server, a mainframe server, or other types ofserver.

In accordance with an embodiment, the server 108 may be a personal mediadevice that may deliver the audio content or the audio-video content tothe head-mounted device 102, via the communication network 110. Examplesof the personal media device may include, but are not limited to, asmartphone, a music player, a video player, a laptop, a personalcomputer, a personal external storage, and a flash drive.

The communication network 110 may include a communication medium throughwhich the head-mounted device 102 and the server 108 may communicatewith each other. Examples of the communication network 110 may include,but are not limited to, the Internet, a cloud network, a WirelessFidelity (Wi-Fi) network, a Personal Area Network (PAN), a Local AreaNetwork (LAN), or a Metropolitan Area Network (MAN). Various devices inthe network environment 100 may be configured to connect to thecommunication network 110, in accordance with various wired and wirelesscommunication protocols. Examples of such wired and wirelesscommunication protocols may include, but are not limited to, at leastone of a Transmission Control Protocol and Internet Protocol (TCP/IP),User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), FileTransfer Protocol (FTP), Zig Bee, EDGE, IEEE 802.11, light fidelity(Li-Fi), 802.16, IEEE 802.11s, IEEE 802.11g, multi-hop communication,wireless access point (AP), device to device communication, cellularcommunication protocols, and Bluetooth (BT) communication protocols.

In operation, the head-mounted device 102 may be configured to receivean audio segment which corresponds to the audio content such as a song,a musical tone, and a video which also includes audio data. In someembodiments, the audio segment may be of live music or song performed ata live event in real time. In some other embodiment, the received audiosegment may be pre-recorded audio content that may be received from theinternal memory or from the server 108, via the communication network110. In some embodiments, the audio segment may be received from anaudio capturing device, such as microphone, associated with a humanspeaker (such as singer) during the live event. The head-mounted device102 may be worn by the wearer 114.

In accordance with an embodiment, the head-mounted device 102 mayinclude the first image capturing device 104. The first image capturingdevice 104 may be configured to capture an image of the first scene 112in a line-of-sight (LOS) of the wearer 114. The captured image mayinclude one or more living or non-living objects. In accordance with anembodiment, the head-mounted device 102 may further include a secondimage capturing device that may be configured to track an eye movementof the wearer 114. An example of the second image capturing device mayinclude, but is not limited to, an image sensor configured to track theeye movement of the wearer 114. The LOS of the wearer 114 may bedetermined based on the tracked eye movement of the wearer 114. Inaccordance with an embodiment, the head-mounted device 102 may furtherinclude an orientation sensor configured to determine an orientation ofthe head-mounted device 102 in a worn state of the head-mounted device102. The orientation sensor may be configured to determine theorientation of the head-mounted device 102 with respect to the positionof head of the wearer 114. The head-mounted device 102 may be configuredto determine the LOS of the wearer 114 based on the determinedorientation and the tracked eye movement of the wearer 114.

In accordance with an embodiment, the head-mounted device 102 may befurther configured to determine a level of each image characteristic ofa plurality of image characteristics of a background portion and aforeground portion of the captured image. The plurality of imagecharacteristics may correspond to ambient lighting conditions. Theambient lighting conditions may be lighting conditions of the firstscene 112 or lighting conditions around the head-mounted device 102 in adirection of the LOS of the wearer 114. In accordance with anembodiment, the plurality of image characteristics may include, but arenot limited to, a brightness, a contrast, a background color, aforeground color, a saturation, a hue, and a gamma parameter of thecaptured image. The head-mounted device 102 may be configured todetermine the level of each image characteristic considering theinfluence of the ambient lighting conditions on the plurality of imagecharacteristics of the captured image. For example, when the first imagecapturing device 104 captures the image of the first scene 112 in a day,a brightness level of the captured image will be higher as compared towhen the first image capturing device 104 captures the image of thefirst scene 112 at night. The brightness level of the captured image maybe a measure of overall lightness or overall darkness of the capturedimage.

In accordance with an embodiment, the head-mounted device 102 may befurther configured to store lyrics or closed caption informationassociated with the audio content, for example, a song. The lyrics orclosed caption information may include textual representation,transcription or translation of the audio content. The head-mounteddevice 102 may be further configured to identify a position of thereceived audio segment in the audio content, based on the stored lyricsinformation. The head-mounted device 102 may be configured to extracttext information (e.g. closed caption information) from the storedlyrics information based on the identified position. The extracted textinformation may be associated with the received audio segment. Inaccordance with an embodiment, the audio content may includesynchronization information which may indicate timing information. Thehead-mounted device 102 may be configured to extract the textinformation from the stored lyrics information based on the timinginformation associated with the audio segment of the audio content. Forexample, the timing information of the audio segment (i.e. portion of asong) indicates a song portion of 3 seconds (say from 10^(th) second to12^(th) second) of the audio content. In such case, the head-mounteddevice 102 may be configured to extract the text information (i.e.closed caption of the audio segment) of 3 seconds (say from 10^(th)second to 12^(th) second) from the stored lyrics information.

In accordance with an embodiment, the head-mounted device 102 mayfurther include a transparent display 106. The transparent display 106may be configured to display the plurality of images of the first scene112 which are also captured by the first image capturing device 104. Thehead-mounted device 102 may be further configured to estimate a firstregion on a display portion of the transparent display 106 for displayof the text information associated with the received audio segment. Thefirst region may be estimated based on the determined level of eachimage characteristic from the plurality of image characteristics of thecaptured image. For example, the estimated first region on the displayportion of the transparent display 106 may be determined based on oneregion in the captured image where the brightness level and the contrastlevel may be higher than other regions of the captured image. In someembodiments, the first region may be estimated based on the determinedLOS (i.e. where the wearer 114 may be currently looking at) of thewearer 114. For example, if the LOS of the wearer 114 changes from afirst position to a second position, then the estimated first region onthe display portion may change to a second region on the display portionof the transparent display 106. In another example, if an object, in thecaptured image, that may gain an attention of the wearer 114, then theLOS of the wearer 114 may change, and therefore, the estimated firstregion on the display portion may change to a second region on thedisplay portion based on the change LOS of the wearer 114.

The head-mounted device 102 may be further configured to select a set ofdisplay characteristics from a plurality of display characteristics forthe display of the text information (e.g. text for the received audiosegment). The plurality of display characteristics may include aforeground color, a background color, a contrast, and a brightness ofthe text information to be displayed on the display portion of thetransparent display. The head-mounted device 102 may be furtherconfigured to determine a level of each display characteristic from theselected set of display characteristics for the text information. Thelevel of each display characteristic may be determined based on theestimated first region and the determined level of each imagecharacteristic of the captured image. For example, a brightness leveland a foreground color (or font color) for the text information may bedetermined based on the determined background color of the capturedimage and the estimated first region. The determined level of eachdisplay characteristic for the text information may be in contrast withthe determined level of each image characteristic of the captured image.For example, the foreground color of the text information may bedetermined based on the background color of the captured image, suchthat the foreground color of the text information is in contrast withthe background color of the captured image and the estimated firstregion on the display portion such that visibility and clarity of thetext information is high.

The head-mounted device 102 may be further configured to control thedisplay of the text information in the estimated first region of thedisplay portion of the transparent display 106. The text information maybe displayed within the estimated first region which may be determinedbased on the LOS of the wearer 114. Thus, the text information may bedisplayed in the estimated first region wherever the wearer 114 may becurrently looking. In another embodiment, the text information may bedisplayed within the first region which may not obstruct a view of aplurality of objects in the first scene 112 through the see-throughtransparent display 106 of the head-mounted device 102. In accordancewith an embodiment, the head-mounted device 102 may be furtherconfigured to control display of the text information based on thedetermined level of each display characteristic of the text information.

In accordance with an embodiment, the head-mounted device 102 may befurther configured to partition the captured image into a plurality ofimage regions. The head-mounted device 102 may be further configured toestimate a brightness level for each of the plurality of image regions.The brightness level for each of the plurality of image regions may bedifferent. The head-mounted device 102 may be further configured todetermine a first image region from the plurality of image regions basedon the brightness level for each of the plurality of image regions. Thefirst image region may be determined such that, the brightness level ofthe determined first image region may be maximum among the brightnesslevel for each of the plurality of image regions. In some embodiments,the first image region may correspond to the estimated first region onthe display portion of the transparent display 106. In accordance withan embodiment, the head-mounted device 102 may be further configured tocontrol the display of the text information within the determined firstregion of the display portion of the transparent display 106, based onthe determined first image region of the captured image. The partitionof the captured image in the plurality of image regions and display ofthe text information in the first image region is further shown anddescribed, for example, in FIGS. 6A and 6B.

In accordance with an embodiment, the head-mounted device 102 mayfurther include a speaker configured to output the received audiosegment. The head-mounted device 102 may be configured to controlplayback of the received audio segment via the speaker. The head-mounteddevice 102 may control the playback of the received audio segment suchthat the output of the audio segment is in synchronization with thedisplay of the text information in the first region of the displayportion of the transparent display 106. Thus, the wearer 114 of thehead-mounted device 102 may be able to view the text informationassociated with the received audio segment on the display portion of thetransparent display 106 and concurrently hear the received audio segmentvia the speaker in real-time or near real-time.

In accordance with an embodiment, the head-mounted device 102 may befurther configured to control display of an enhanced view of an object,of the one or more objects in the foreground portion of the capturedimage, on the display portion of transparent display 106. Thehead-mounted device 102 may be configured to control the display of theenhanced view of the object, based on a selection of the object in thecaptured image. The head-mounted device 102 may receive a user-input(for example a zoom operation) for the selection of the object from theone or more objects in the captured image from the wearer 114. Thehead-mounted device 102 may be further configured to determine the levelof each image characteristic of the plurality of image characteristicsassociated with the enhanced view of the object. For example, thehead-mounted device 102 may be configured to determine the brightnesslevel, the contrast level, the background color, or the foreground colorof the enhanced view of the object in the captured image.

The head-mounted device 102 may be further configured to determine thelevel of each display characteristic from the set of displaycharacteristics (such as brightness, contrast, etc.) for the textinformation based on the determined level of each image characteristicassociated with the enhanced view of the object. For example, thehead-mounted device 102 may be configured to determine a brightnesslevel and a foreground color for the text information based on theforeground color of the enhanced view of the object of the capturedimage. The display of the enhanced view of the object of the capturedimage and the text information is further shown and described in detail,for example, in FIGS. 7A and 7B.

FIG. 2 is a block diagram that illustrates an exemplary head-mounteddevice for display of information related to audio content based onambient lighting conditions, in accordance with an embodiment of thedisclosure. FIG. 2 is explained in conjunction with elements fromFIG. 1. With reference to FIG. 2, there is shown the head-mounted device102. The head-mounted device may include the first image capturingdevice 104, a circuitry 202, a second image capturing device 204, anorientation sensor 206, a memory 208, a network interface 210, and aninput/output (I/O) device 212. The I/O device 212 may include a speaker212A and the transparent display 106. The transparent display 106 may beutilized to render an application interface 214. The circuitry 202 maybe communicatively coupled to the first image capturing device 104, thetransparent display 106, the second image capturing device 204, theorientation sensor 206, the memory 208, and the I/O device 212. Thecircuitry 202 may be configured to communicate with the server 108, byuse of the network interface 210.

The circuitry 202 may comprise suitable logic, circuit, and interfacesthat may be configured to control one or more operations of the firstimage capturing device 104, the transparent display 106, the secondimage capturing device 204, the orientation sensor 206, the memory 208,and the I/O device 212. The circuitry 202 may be further configured todetermine the level of each image characteristic of the plurality ofimage characteristics of the background portion and the foregroundportion of the image captured by the first image capturing device 104.The circuitry 202 may be further configured to determine the level ofeach display characteristic from the set of display characteristics ofthe text information associated with the audio segment. The circuitry202 may further control display of the text information in the firstregion of the display portion of the transparent display 106, based onthe determined level of each display characteristic from the set ofdisplay characteristics. The circuitry 202 may be implemented based on anumber of processor technologies known in the art. Examples of theprocessor technologies may be a Graphical Processing Unit (GPU), aCentral Processing Unit (CPU), X86-based processor, a ReducedInstruction Set Computing (RISC) processor, an Application-SpecificIntegrated Circuit (ASIC) processor, a Complex Instruction Set Computing(CISC) processor, other processors, and the like.

The second image capturing device 204 may comprise suitable logic,circuitry, and interfaces that may be configured to track eye movementof the wearer 114. The second image capturing device 204 may be furtherconfigured to determine the LOS of the wearer 114. In accordance with anembodiment, the second image capturing device 204 may be implementedbased on a plurality of sensors. The plurality of sensors may beimplemented as embedded/wearable sensors with the head-mounted device102. Examples of the second image capturing device 204 may include, butare not limited to, a camera, an image sensor, an action camera, aclosed-circuit television (CCTV) camera, a camcorder, a night-visioncamera and/or other image capturing devices.

The orientation sensor 206 may comprise suitable logic, circuitry, andinterfaces that may be configured to determine the orientation of thehead-mounted device 102 in the worn state of the head-mounted device102. The orientation sensor 206 may be configured to determine theorientation of the head-mounted device 102 in the worn state, withrespect to a position of the head of the wearer 114. In someembodiments, the orientation sensor 206 may be configured to determinemovement of the head-mounted device 102 or the head of the wearer 114.The orientation sensor 206 may be implemented based on a plurality ofsensors. The plurality of sensors may be implemented asembedded/wearable sensors with the head-mounted device 102. Examples ofthe orientation sensor 206 may include, but are not limited to, agyroscope, an accelerometer, a tilt sensor, or other orientation sensorknown in the art.

The memory 208 may comprise suitable logic, circuitry, and interfacesthat may be configured to store one or more images captured by the firstimage capturing device 104. The memory 208 may be further configured tostore the received audio segment that corresponds to the audio content(e.g. a song). The memory 208 may be further configured to store thelyrics information associated with the audio content. Examples ofimplementation of the memory 208 may include, but are not limited to,Random Access Memory (RAM), Read Only Memory (ROM), ElectricallyErasable Programmable Read-Only Memory (EEPROM), Hard Disk Drive (HDD),a Solid-State Drive (SSD), a CPU cache, and/or a Secure Digital (SD)card.

The network interface 210 may comprise suitable logic, circuitry, andinterfaces that may be configured to facilitate communication betweenthe head-mounted device 102 and the server 108, via the communicationnetwork 110. The network interface 210 may be implemented by use ofvarious known technologies to support wired or wireless communication ofthe head-mounted device 102 with the communication network 110. Thenetwork interface 210 may include, but is not limited to, an antenna, aradio frequency (RF) transceiver, one or more amplifiers, a tuner, oneor more oscillators, a digital signal processor, a coder-decoder (CODEC)chipset, a subscriber identity module (SIM) card, or a local buffercircuitry.

The I/O device 212 may comprise suitable logic, circuitry, andinterfaces that may be configured to receive an input from a user (suchas the wearer 114) and provide an output to the wearer 114 based on thereceived input from the wearer 114. The I/O device 212 may includevarious input and output devices, which may be configured to communicatewith the circuitry 202. Examples of the I/O device 212 may include, butare not limited to, a touch screen, a keyboard, a mouse, a joystick, amicrophone, a display (for example, the transparent display 106), and aspeaker (for example, the speaker 212A).

The application interface 214 may correspond to a user interface (UI)rendered on a display, such as the transparent display 106. Theapplication interface 214 may display the text information on thedisplay portion of the transparent display 106. An example of theapplication interface 214 may include, but is not limited to, agraphical user interface (GUI).

FIG. 3A illustrates a first exemplary scenario of a head-mounted deviceworn by a wearer to view a scene, in accordance with and embodiment ofthe disclosure. FIG. 3A is explained in conjunction with elements fromFIG. 1 and FIG. 2. With reference to FIG. 3A, there is shown thehead-mounted device 102, the first image capturing device 104, the firstscene 112, the wearer 114, the second image capturing device 204, and afield-of-view 302 of the first image capturing device 104. In accordancewith an embodiment, the head-mounted device 102 may be a wearable devicethat may be worn by the wearer 114 to view the first scene 112. Inaccordance with an embodiment, the head-mounted device 102 may includethe first image capturing device 104 on a front side of the head-mounteddevice 102 to face the first scene 112. In accordance with anembodiment, the head-mounted device 102 may further include the secondimage capturing device 204 on a back side of the head-mounted device 102to face the eyes of the wearer 114. In some embodiments, the secondimage capturing device 204 may be disposed at a particular position on abody of the head-mounted device 102 such that a field-of-view of thesecond image capturing device 204 is towards the eyes of the wearer 114.

The first image capturing device 104 may be configured to capture animage of the first scene 112 in the field-of-view 302 of the first imagecapturing device 104, based on the LOS of the wearer 114. The secondimage capturing device 204 may be configured to determine the LOS of thewearer 114 of the head-mounted device 102, based on a track of an eyemovement of the wearer 114. The second image capturing device 204 may beconfigured to track the movement of the eyes of the wearer 114 viewingthe first scene 112. The LOS of the wearer 114 may be determined furtherbased on the orientation of the head-mounted device 102. The orientationsensor 206 of the head-mounted device 102 may be configured to determinethe orientation of the head-mounted device 102 with respect the positionof the head of the wearer 114. The first scene 112, which may be anoutdoor scene or an indoor scene, may include a plurality of objects.The plurality of objects may be a living object or a non-living object.

FIG. 3B illustrates a side view of an exemplary head-mounted device, inaccordance with an embodiment of the disclosure. FIG. 3B may beexplained in conjunction with elements from FIG. 1, FIG. 2 and FIG. 3A.With reference to FIG. 3B, there is shown a side view of thehead-mounted device 102. The head-mounted device 102 may include thefirst image capturing device 104, the transparent display 106, and thesecond image capturing device 204. In accordance with an embodiment, thefirst image capturing device 104 may be positioned on an element whichconnects two display portions of the transparent display 106. In someembodiments, the first image capturing device 104 may be positioned at acenter position of the transparent display 106. In another embodiment,the first image capturing device 104 may be mounted on a particularposition on an outer body of the head-mounted device 102 to face thefirst scene 112.

In accordance with an embodiment, the second image capturing device 204may be positioned on the transparent display 106, such that the secondimage capturing device 204 may face towards the eyes of the wearer 114of the head-mounted device 102. In accordance with an embodiment, thetransparent display 106 may be a see-through glass.

It may be noted that the head-mounted device 102 shown in FIG. 3B ismerely an example. The present disclosure may be also applicable toother types and structures of the head-mounted device 102 with variouspositions of the first image capturing device 104 and the second imagecapturing device 204. A description of other types and structures of thehead-mounted device 102 has been omitted from the disclosure for thesake of brevity.

FIG. 4 illustrates an exemplary scenario which depicts a plurality ofimages captured by an image capturing device of the head-mounted device,in accordance with an embodiment of the disclosure. FIG. 4 is explainedin conjunction with elements from FIGS. 1, 2, 3A and 3B. With referenceto FIG. 4, there is shown the first scene 112. There is further shown aplurality of images of the first scene 112. The plurality of image mayinclude a first image 402, a second image 404, and a third image 406. Inaccordance with an embodiment, the first image capturing device 104 maybe configured to capture the plurality of images of the first scene 112,based on a line-of-sight (LOS) of the wearer 114 of the head-mounteddevice 102. The first scene 112 may be in the field-of-view of the firstimage capturing device 104. The first image 402 may be captured based ona first LOS of the wearer 114 of the head-mounted device 102. Similarly,the second image 404 and the third image 406 may be captured based on asecond LOS and a third LOS of the wearer 114 of the head-mounted device102, respectively. The first LOS, the second LOS, and the third LOS maybe different from each other. In accordance with an embodiment, thefirst LOS, the second LOS, and the third LOS may be in differentdirections with respect to the second image capturing device 204. Thecaptured image, such as the first image 402, the second image 404, orthe third image 406 may include images of a plurality of objects of thefirst scene 112. For example, as shown in FIG. 4, the first image 402may include the plurality of objects, such as a tree, a bench, a lamppost, and a sun. The second image 404 may include the plurality ofobjects, such as the sun, the lamp post, and a smaller portion of thetree and the bench. The third image 406 may include the lamp post, thebench and the tree of the first scene 112. The captured image, such asthe first image 402, the second image 404, or the third image 406 may bedisplayed on the transparent display 106 for the wearer 114 of thehead-mounted device 102.

In accordance with an embodiment, the level of each imagecharacteristics for each of the first image 402, second image 404, andthe third image 406 may be different, based on a difference in ambientlighting condition or light illumination on the first image capturingdevice 104 of the head-mounted device 102. The ambient lightingcondition on the first image 402, second image 404, and the third image406 may be different due presence of different light sources, such asthe sun or the lamp post in the first scene 112. For example, the firstimage 402 and the second image 404 may be brighter than the third image406 due to presence of both sun and the glowing lamp post as the objectsin the first image 402 and the second image 404. In another example, acontrast level of the third image 406 may be more than a contrast levelof the first image 402 and the second image 404 due to absence of thesun as the object in the third image 406. Thus, based on change in theLOS of the wearer 114, the head-mounted device 102 may control the firstimage capturing device 104 to capture different images in differentdirections based on the LOS of the wearer 114 detected by the secondimage capturing device 204. The level of each image characteristics inthe captured images may be different based on the ambient lightconditions or the influence of light on the first image capturing device104.

FIGS. 5A and 5B collectively illustrate an exemplary scenario fordisplay of information related to audio content in a live event based onambient lighting conditions, in accordance with an embodiment of thedisclosure. FIGS. 5A and 5B are explained in conjunction with elementsfrom FIGS. 1, 2, 3A, 3B, and 4. With reference to FIG. 5A, there isshown the transparent display 106 and the application interface 214displayed on the transparent display 106. There is further shown animage of an artist 502, images of a plurality of lights 504, and a textinformation 506 displayed on the application interface 214 of thetransparent display 106. In accordance with an embodiment, thehead-mounted device 102 (as shown in FIGS. 3A and 3B) may be worn by thewearer 114 during a live event. The live event may correspond to anevent that occurs in a real time or near real time. Examples of the liveevent may include, but are not limited to, a live concert, a live stageshow, a sport event, or a live event in the field-of-view of the firstimage capturing device 104 (shown in FIG. 3A) of the head-mounted device102. An artist (such as the artist 502) and the plurality of lights 504may be present in the live event. In accordance with an embodiment, theartist 502 and the plurality of lights 504 may be included in a firstscene viewed by the wearer 114 through the transparent display 106 (e.g.see-through display).

In accordance with an embodiment, the circuitry 202 may be configured toreceive the audio segment, such as a song sung or performed by theartist 502 (e.g., a singer) in the real-time during the live event. Insome embodiments, the audio segment may correspond to the audio contentretrieved from the memory 208 of the head-mounted device 102 or receivedfrom the server 108. The circuitry 202 may be further configured tocontrol the first image capturing device 104 to capture a first image ofthe first scene of the live event in the line-of-sight (LOS) of thewearer 114 of the head-mounted device 102. Thus, the first imagecapturing device 104 may be configured to capture the first image of thefirst scene in a direction where the wearer 114 might be looking in theworn state of the head-mounted device 102. The captured first image mayinclude a plurality of objects, such as images of the artist 502 and theplurality of lights 504.

The circuitry 202 may be further configured to determine the level ofeach image characteristic of the plurality of image characteristics of abackground portion and/or a foreground portion of the captured firstimage. The foreground portion of the captured first image may includethe plurality of objects. The plurality of image characteristics mayinclude, but are not limited to, a brightness, a contrast, a backgroundcolor, a foreground color, a saturation, a hue, and a gamma parameter ofthe captured first image. The level of each image characteristic of theplurality of image characteristics may vary in each region of aplurality of regions of the captured first image. For example, thebrightness level in one region of the captured first image may be higherthan other regions based on the lighting conditions around the firstimage capturing device 104. In another example, a color level (e.g. RGB)in different regions of the first image may be different.

In accordance with an embodiment, the plurality of image characteristicsmay correspond to ambient lighting conditions around the head-mounteddevice 102 or in field-of-view of the first image capturing device 104.For example, a brightness level (i.e. image characteristic) of thecaptured first image may be dependent on a state of the plurality oflights 504 present in the first scene of the live event or in front ofthe first image capturing device 104. As shown in FIG. 5A, for example,the plurality of lights 504 may be in an inactive state or “OFF” state.In such case, the brightness level of a first image region near theplurality of lights 504 in the captured first image may be lower thanother image regions of the first image. In another example, in the “OFF”state, the brightness level of the complete first image may be lowerthan when the plurality of lights 504 may be in “ON” state.

The circuitry 202 may be configured to estimate a first region 508 on adisplay portion (such as application interface 214) of the transparentdisplay 106 for display of the text information 506 based on thedetermined level of each image characteristic of the first image ordifferent regions of the first image. The estimated first region 508 onthe display portion of the transparent display 106 may correspond to thefirst image region near the plurality of lights 504 in the capturedfirst image. In accordance with an embodiment, pixel information orimage coordinates of the estimated first region 508 on the displayportion of the transparent display 106 may be similar to the first imageregion in the captured first image, in case a display resolution of thetransparent display 106 is equal to an imaging resolution of the firstimage capturing device 104.

In accordance with an embodiment, the first region 508 on the displayportion may be estimated such that the text information 506 to bedisplayed in the first region 508 does not obscure the plurality ofobjects of the first scene when viewed by the wearer 114 though thetransparent display 106. Thus, the first region 508 may not be estimatedor selected on the foreground portion or for the plurality of objectsviewed by the wearer 114. Alternatively, the first region 508 may beselected on the background portion of the captured first image.

In some embodiments, the first region 508 on the display portion may beestimated based on the determined level of each image characteristic ofthe first image. In some embodiments, the first region 508 on thedisplay portion may be estimated based on the determined level of eachimage characteristic of different regions of the first image. The firstregion 508 may be estimated on the transparent display 106 such that thevisibility and clarity of the text information 506 to be displayed onthe first region 508 is high. For example, the first region 508 may notbe estimated or selected for a region which indicates a color backgroundpattern because the visibility and readability of the text information506 in such case may be low. In accordance with an embodiment, the firstregion 508 may be estimated based on user information stored in thememory 208. The user information may include a color preferred or likedby the wearer 114. For example, the first region 508 in the backgroundportion may be selected to display the text information 506 in case thecolor level of the background portion is blue as the user information.In some embodiments, the user information may indicate a color which maynot be liked or not recognized by the wearer 114. For example, thewearer 114 has a deficiency of color blindness for a red color, then thecircuitry 202 may be configured to read the user information and may notselect the background portion with the red color level as the firstregion 508 to display the text information 506. In FIG. 5A, the firstregion 508 may be selected based on the level of different imagecharacteristics (for example, brightness, color, or contrast).

In accordance with an embodiment, the circuitry 202 may further beconfigured to determine a first level of each display characteristicfrom a set of display characteristics for the text information 506 basedon the determined level of each image characteristic of the first image.The circuitry 202 may be configured to select the set of displaycharacteristics for the text information 506 from a plurality of displaycharacteristics. In accordance with an embodiment, the plurality ofdisplay characteristics for the text information 506 may include, butare not limited to, a foreground color, a background color, a contrast,and a brightness. The circuitry 202 may be configured to select the setof display characteristics for the display of the text information basedon the determined level of each image characteristic of the plurality ofimage characteristics of the captured first image. For example, based onthe determined brightness level, the contrast level, the backgroundcolor, and the foreground color of the captured first image, thecircuitry 202 may select a foreground color (or font color) and abrightness level of the text information 506 to be displayed on thedisplay portion of the transparent display 106. In some embodiments, thecircuitry 202 may be configured to select the set of displaycharacteristics from the plurality of display characteristics based on auser input provided by the wearer 114 via the I/O device 212. Forexample, the user input from the wearer 114 is to set the foregroundcolor of the text information 506 to red color and background color towhite color. In this regard, the circuitry 202 may be configured toselect the foreground color and the background color as the set ofdisplay characteristics from the plurality of display characteristics.

In accordance with an embodiment, the first level of each displaycharacteristic for the text information 506 may be determined based onthe estimated first region 508 on the display portion. In someembodiments, the first level of each display characteristic for the textinformation 506 may be determined based on a determined level of eachimage characteristic in the estimated first region 508. The set ofdisplay characteristics may include a color value, a brightness value, acontrast value or size of the text information 506. For example, if thecolor level of the background of the first region 508 is “White”, thenthe color level for the text information 506 may be “Black”. The colorlevel (i.e. display characteristics) for the text information 506 may bein contrast with the color level (i.e. image characteristic) of thebackground of the first region 508 to further increase the visibilityand clarity of the text information. As another example, in case thebrightness level of the first region 508 or the first image is high (sayduring day time), then the circuitry 202 may be configured to select ahigh contrast level as the display characteristics for the display ofthe text information 506. As another example, in case the brightnesslevel of the first region 508 or the first image is low (say duringnight time), then the circuitry 202 may be configured to select a highbrightness level as the display characteristics for the display of thetext information 506 so that the visibility of the displayed textinformation is high irrespective of the influence of light sources onthe transparent display 106 of the head-mounted device 102.

In accordance with an embodiment, the size of the text information 506may be determined based on a size of area of the estimated first region508. The circuitry 202 may be further configured to control display ofthe text information 506 in the estimated first region 508 of thetransparent display 106 based on the determined first level of eachdisplay characteristic from the set of display characteristics. Forexample, as shown in FIG. 5A, the text information 506 (such as “Hymnfor the”) may be displayed in the first region 508 on the applicationinterface 214 of the transparent display 106. The text information 506may be displayed such that, the text information 506 is clearly visibleto the wearer 114 on the transparent display 106 with high visibility(or clarity) and without obscuring the plurality of objects (e.g. artist502 and the plurality of lights 504) in the field of view of the wearer114. In accordance with an embodiment, the text information 506 may bedisplayed within the first region 508 without an overlap with asee-through region-of-interest (i.e. plurality of objects) in thedisplay portion of the transparent display 106, in the worn state of thehead-mounted device 102.

With reference to FIG. 5B, there is shown a scenario, where theplurality of lights 504 in a second scene may be in an active state or“ON” state. In accordance with an embodiment, the circuitry 202 may beconfigured to control the first image capturing device 104 to capture asecond image of the second scene, based on the LOS of the wearer 114.The captured second image may also include the plurality of objects,such as the artist 502 and the plurality of lights 504. In accordancewith an embodiment, the positions of the plurality of objects in thecaptured second image may be different than the positions of the sameplurality of objects in the captured first image (as shown and describedin FIG. 5A). In some embodiments, a number of objects captured in thesecond image may be different from a number of objects captured in thefirst image.

In accordance with an embodiment, the circuitry 202 may be configured todetermine a level of each image characteristic of the plurality of imagecharacteristics of the background portion and the foreground portion ofthe captured second image. The level of each image characteristic of thecaptured second image may be different than the level of each imagecharacteristic of the captured first image, based on the active or “ON”state of the plurality of lights 504 in the second image. For example,the brightness level of a region near the plurality of lights 504 in thecaptured second image may be higher than the other regions of the secondimage of the second scene, when the plurality of lights 504 are in anactive state or “ON” state. In another example, the brightness level ofthe second image (where the plurality of lights 504 are in ON state) maybe higher than the first image (where plurality of lights 504 are in OFFstate as shown in FIG. 5A)

The circuitry 202 may be further configured to estimate a second regionon the display portion of the transparent display 106 for display of thetext information 506 based on the determined level of each imagecharacteristic of the plurality of image characteristics of the secondimage. For example, as shown in FIG. 5B, if the plurality of lights 504may be in the active state or “ON” state, the circuitry 202 may estimatea second region 510 near head of the artist 502 for display of the textinformation 506 as the brightness level of a region near the pluralityof lights 504 may be high as compared to the other regions of the secondimage. The circuitry 202 may discard the first region 508 (shown in FIG.5A) near the plurality of lights 504 due to high influence of theplurality of lights 504 on the first region 508. Due to high influenceof the plurality of lights 504 on the first region 508, the textinformation 506 may not be clearly visible in the first region 508 andmay have low clarity. In accordance with an embodiment, the secondregion 510 on the display portion (such as the application interface214) may be estimated such that, the text information 506 displayed onthe second region 510 may be not obscure or overlap the images of theplurality of objects and may have high visibility for the wearer 114irrespective of the influence of the ambient light or the light sourceson the transparent display 106.

The circuitry 202 may be further configured to determine a second levelof each display characteristic from the set of display characteristicsfor the text information 506 based on the determined level of each imagecharacteristic of the second image or the estimated second region 510.The second level of each display characteristic may be different fromthe first level of each display characteristic based on the change inposition of the plurality of objects from the first scene to the secondscene and/or the change in state of the plurality of lights 504 (forexample from OFF state in FIG. 5A to ON state in FIG. 5B). For example,a contrast level (e.g. display characteristics) of the text information506 to be displayed in the second region 508 may be higher than acontrast level for the text information 506 displayed in the firstregion (shown in FIG. 5A). In another example, the contrast level forthe text information 506 to be displayed on the second region 510 may behigh because of a high brightness level (e.g. image characteristics) ofthe second image or the second region 510 due to the influence of theplurality of lights 504 in ON state in FIG. 5B. In another example, thecircuitry 202 may be configured to determine the color level for thetext information 506 to be displayed on the second region 510 based onthe determined image characteristics (such as color, brightness,contrast) of the second region 510 such that the visibility of the textinformation 506 would be high for the wearer 114.

In accordance with an embodiment, the circuitry 202 may be configured todetermine the size of the text information 506 to be displayed in thesecond region 510 based on the size of the second region 510 and thedetermined level of each image characteristics of the second region 510.For example, the size of the text information 506 to be displayed in thesecond region 510 may be greater than the text size of the textinformation 506 displayed in the first region 508 (shown in FIG. 5A)because of the influence of the plurality of lights 504 in the ON statein FIG. 5B. The higher size of the text information 506 may allow thewearer 114 to clearly view the text information 506 through thetransparent display 106 irrespective of the ON state of the plurality oflights 504 in front of the transparent display 106.

The circuitry 202 may be further configured to control display of thetext information 506 in the estimated second region 510 of thetransparent display 106 based on the determined second level of eachdisplay characteristic from the set of display characteristics. Forexample, as shown in FIG. 5B, the text information 506, such as “Hymnfor the” is displayed in the second region 510 on the applicationinterface 214 of the transparent display 106. The text information 506may be displayed in the second region 510 such that, the textinformation 506 is clearly visible to the wearer 114 with high clarityirrespective of the ON state of the plurality of lights 504 and does notobscure the plurality of objects (e.g. artist 502 and the plurality oflights 504) in the field of view of the wearer 114. Thus, the estimationof the first region 508 or the second region 510 and the determinationof the display characteristics for the text information 506 based on theimage characteristics (or the ambient lighting conditions) provides anadvanced intelligence to the head-mounted device 102 to display the textinformation 506 (or the closed caption information) with bettervisibility for the wearer 114.

In accordance with an embodiment, the circuitry 202 may be configured todynamically re-estimate the second region 510 and determine the displaycharacteristics for the text information 506 based on change in theimage characteristics (or the ambient light conditions) being detectedby the capture of the second scene. In some embodiments, the circuitry202 may be configured to dynamically re-estimate the second region 510and determine the display characteristics based on change in the LOS ofthe wearer 114 detected using the second image capturing device 204. Thechange in the LOS may cause the change in the second scene or change innumber or positions of the plurality of objects captured by the secondimage capturing device 204. In accordance with an embodiment, thecircuitry 202 may be configured to detect the movement or theorientation of the head of the wearer 114 through the orientation sensor206 in the worn state of the head-mounted device 102. The circuitry 202may be further configured to detect the change in the second scene orchange in number or positions of the plurality of objects based on thedetected movement or the orientation of the head of the wearer 114. Thecircuitry 202 may be further configured to re-estimate the second region510 and determine the display characteristics for the text information506 based on detected the change in the second scene or change in thenumber or the positions of the plurality of objects captured by thesecond image capturing device 204. The circuitry 202 may be furtherconfigured to control the display of the text information 506 within theestimated second region 510 of the transparent display 106 based on theLOS of the wearer 114 or detected change in the second scene or changein the number or the positions of the plurality of objects. Thus, thehead-mounted device 102 provides a dynamic run-time control of thedisplay of the text information 506 with higher visibility for thewearer 114 irrespective of the change in the ambient light conditions orchange in the scene (or the plurality of objects in view of the wearer114).

The circuitry 202 may be further configured to control playback of thereceived audio segment, via a speaker, such as the speaker 212A. Forexample, the received audio segment may correspond to the song performedby the artist 502 during the live concert. In some other embodiment, thereceived audio segment may be pre-recorded audio content that may bereceived from the memory 208 or from the server 108. The circuitry 202may control the playback of the received audio segment, via the speaker212A in synchronization with the display of the text information 506(associated with the audio segment) on the transparent display 106.Thus, the wearer 114 of the head-mounted device 102 may view the textinformation 506 (for example, “Hymn for the”, as shown in FIG. 5A)associated with the audio segment with better clarity and concurrentlyhear the audio segment, via the speaker 212A in the real-time or nearreal-time. The concurrent and synchronized display of the textinformation 506 and playback of the associated audio segment mayfacilitate the wearer 114 (either hearing-impaired or visually-impaired)to get better experience of audio-content reproduction.

FIGS. 6A and 6B collectively a plurality of image regions of an imagecaptured by an image capturing device of the head-mounted device, inaccordance with an embodiment of the disclosure. FIGS. 6A and 6B areexplained in conjunction with elements from FIGS. 1, 2, 3A, 3B, 4, 5A,and 5B. With reference to FIG. 6A, there is shown the first image 402captured by the first image capturing device 104. In accordance with anembodiment, the circuitry 202 may be configured to partition the firstimage 402 in a plurality of image regions, such as a first image region602, a second image region 604, a third image region 606, a fourth imageregion 608, a fifth image region 610, and a sixth image region 612. Eachimage region of the plurality of image regions may include a set ofpixels or sub-pixels of the first image 402.

With reference to FIG. 6B, there is shown the first image 402, whichincludes the first image region 602, the second image region 604, thethird image region 606, the fourth image region 608, the fifth imageregion 610, the sixth image region 612, and a text information 614. Inaccordance with an embodiment, the circuitry 202 may be configured todetermine the level of each image characteristic of the plurality ofimage characteristics for each image region of the plurality of imageregions of the first image 402. The level of each image characteristicof the plurality of image characteristics for each image region may bedifferent. In accordance with an embodiment, examples of the pluralityof image characteristics may include, but are not limited to, abrightness, a contrast, a background color, a foreground color, asaturation, a hue, and a gamma parameter of the first image 402.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to determine an image region, such as the second image region604, from the plurality of image regions based on the determined levelof each image characteristic for each image region of the plurality ofimage regions. For example, the circuitry 202 may be configured todetermine a brightness level for each image region of the plurality ofimage regions. The circuitry 202 may be further configured to comparethe determined brightness level of each of the plurality of imageregions to identify the image region of the first image 402, which hasthe maximum brightness level. As per FIG. 6B, the circuitry 202 may beconfigured to identify the second image region 604 with maximumbrightness level as compared to the brightness levels of other imageregions of the plurality of image regions. For example, the brightnesslevel of the second image region 604 may be maximum due to lightillumination from two light sources, for example, the sun and the lamppost (as shown in FIGS. 6A and 6B) captured in the second image region604. On the other hand, the brightness level of the fifth image region610 may be lesser due to shade from an object, such as the tree capturedin the fifth image region 610 of the first image 402.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to determine a level of each display characteristic from theset of display characteristics of the text information 614 (for example,“Every” as shown in FIG. 6B) associated with the received audio segment.The audio segment may be a portion of the song to be rendered insynchronization with the display of the first image 402 on thetransparent display 106. The text information may represent the textualrepresentation (for example lyric information) of the received audiosegment.

The circuitry 202 may be configured to determine a level of brightness,contrast, foreground color, background color of the text information 614to be displayed on the second image region 604 which is identified basedon the brightness levels of the plurality of image regions of the firstimage 402. In accordance with an embodiment, the level of each displaycharacteristic from the set of display characteristics of the textinformation 614 may be determined based on the level of each of theimage characteristics associated with the second image region 604. Thecircuitry 202 may be configured to determine the level of each displaycharacteristic of the text information 614 such that, the determinedlevel of each display characteristic may be in contrast with the levelof each image characteristic associated with the second image region604. For example, a foreground color value (or font color) of the textinformation 614 may be in contrast with a background color value of thesecond image region 604. In another example, the brightness level (i.e.display characteristics) of the text information 614 may be different(or in contrast) from the brightness level (i.e. image characteristic)associated with the second image region 604 of the first image 402.Thus, the wearer 114 of the head-mounted device 102 may be able toclearly distinguish between the displayed text information 614 and aportion of the first scene 112 displayed on the second image region 604.Such clear distinguish between the display characteristics of the textinformation 614 and the image characteristics of the second image region604 may allow the wearer 114 to clearly read or recognize the textinformation 614 even though the image characteristics are being affectedbased on the influence of the ambient lighting condition around thehead-mounted device 102. In accordance with an embodiment, the circuitry202 may be configured to determine the second image region 604 as thebrightest region among the plurality of image regions and control thedisplay of the text information 614 within a region on the transparentdisplay 106 based on the determined second image region 604. The regionon the transparent display 106 may be similar (i.e. with same pixelinformation) to the determined second image region 604 of the firstimage 402.

FIGS. 7A and 7B collectively illustrate an exemplary scenario fordisplay of information related to audio content based on ambientlighting conditions associated with an enhanced view of an object in acaptured image, in accordance with an embodiment of the disclosure.FIGS. 7A and 7B are explained in conjunction with elements from FIGS. 1,2, 3A, 3B, 4, 5A, 5B, 6A, and 6B. With reference to FIG. 7A, there isshown the transparent display 106, the application interface 214 and aplurality of objects captured in a first scene (for example a liveevent) in field of view of the first image capturing device 104. Thecaptured images of the plurality of objects may be displayed on theapplication interface 214 of the transparent display 106. In accordancewith an embodiment, the plurality of objects may include a first object702 (such as an artist in the live event). For example, the capturedimage of the first scene may include a singer, other technicians, suchas a drummer, a pianist, and the like.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to receive a user-input, through the I/O device 212, forselection of an object, such as the first object 702. The selection maybe to display an enhanced view (such as zoomed view) of the first object702. The circuitry 202 may be configured to receive the selection of thefirst object 702 from the plurality of objects via the applicationinterface 214 (e.g. a user interface). For example, the wearer 114 ofthe head-mounted device 102 may be at a specific distance from a stageduring the live event and may not be able to clearly see the artist(i.e. first object 702) singing on the stage. Therefore, the circuitry202 may be configured to receive the selection of the artist (i.e. firstobject 702) from the wearer 114 to view the enhanced view of the firstobject 702.

With reference to FIG. 7B, there is shown the transparent display 106with display of an enhanced view 704 of the first object 702. Thecircuitry 202 may be further configured to control display of theenhanced view 704 of the first object 702 on the transparent display106, based on the selection (e.g. zoom operation) of the first object702 by the wearer 114. In accordance with an embodiment, the circuitry202 may be further configured to determine the level of each imagecharacteristic of the plurality of image characteristics associated withthe enhanced view 704 of the first object 702. The level of each imagecharacteristic of the plurality of image characteristics associated withthe enhanced view 704 of the first object 702 may be based on theambient lighting conditions around the first object 702 in the liveevent. In some embodiments, the enhanced view 704 of the first object702 may be enhancement in the level of image characteristic of the firstobject 702 on the transparent display 106.

The circuitry 202 may be further configured to estimate a first region708 for display of the text information 706, associated with thereceived audio segment, on the display portion (i.e. applicationinterface 214) of the transparent display 106 of the head-mounted device102. In accordance with an embodiment, for example, the received audiosegment may be a portion of the song sung by the artist (i.e. firstobject 702) during the live event. The text information 706 associatedwith the received audio segment may be the lyrics information associatedwith the portion of the song sung by the artist (i.e. first object 702)during the live concert. The first region 708 for the display of thetext information 706 may be estimated based on the determined level ofeach image characteristics of the plurality of image characteristicsassociated with the enhanced view 704 of the first object 702 asdescribed in detail in FIGS. 5A and 5B. The circuitry 202 may beconfigured to estimate the first region 708 for display of the textinformation 706 such that the displayed text information 706 may havehigher visibility and does not obscure the plurality of objects (such asthe first object 702) displayed on the transparent display 106. Forexample, as shown in FIG. 7B, the text information 706, such as “Hymnfor the”, is displayed near feet of the first object 702 (e.g., asinger) in the captured image such that the obstructed vision of theenhanced view of the first object 702 may be prevented.

The circuitry 202 may be further configured to determine a level of eachdisplay characteristic from the set of display characteristicsassociated the text information 706 associated with the received audiosegment (such as the portion of the song sung by the artist during thelive concert). The level of each display characteristic from the set ofdisplay characteristics (such as brightness, contrast, font size, color,and the like) may be determined based on the determined level of eachimage characteristic associated with the enhanced view 704 of the firstobject 702 or the estimated first region 708 as described in detail, forexample, in FIGS. 6A and 6B. The circuitry 202 may be further configuredto control display of the text information 706 in the estimated firstregion 708 based on the determined level of each display characteristicfrom the set of display characteristics for the text information 706.

FIG. 8 depicts a flowchart that illustrates exemplary operations fordisplay of information related to audio content based on ambientlighting conditions, in accordance with an embodiment of the disclosure.With reference to FIG. 8, there is shown a flowchart 800. The flowchart800 is described in conjunction with FIGS. 1, 2, 3A, 3B, 4, 5A, 5B, 6A,6B, 7A, and 7B. The operations from 804 to 816 may be implemented in thehead-mounted device 102. The operations of the flowchart 800 may startat 802 and proceed to 804.

At 804, an audio segment may be received, that corresponds to audiocontent. The circuitry 202 may be configured to receive the audiosegment that corresponds to the audio content (such as a song, a musicfile). In some embodiments, the audio segment may be pre-recorded andmay be received from the server 108, via the communication network 110.In some embodiments, the audio segment may be retrieved from the memory208. In another embodiment, the audio segment may be received from anaudio capturing device, such as microphone, which captures the audiosegment during a live event (such as a live concert or livepresentation).

At 806, the first image capturing device 104 may be controlled tocapture an image of a scene in a line-of-sight (LOS) of the wearer 114of the head-mounted device 102. The circuitry 202 may be configured tocontrol the first image capturing device 104 to capture the image of thescene in the LOS of the wearer 114. The LOS of the wearer 114 may bedetermined using the second image capturing device 204 and theorientation sensor 206 of the head-mounted device 102.

At 808, a level of each image characteristic of the plurality of imagecharacteristics of a background portion and a foreground portion of thecaptured image may be determined, where the plurality of imagecharacteristics correspond to ambient lighting conditions. The circuitry202 may be configured to determine the level of each imagecharacteristic of the plurality of image characteristics of thebackground portion and the foreground portion of the captured image. Insome embodiments, the circuitry 202 may be configured to partition thecaptured image in a plurality of regions. The circuitry 202 may befurther configured to determine the level of each image characteristicof the plurality of image characteristics for each of the plurality ofregions of the captured image. The partitioning of the captured image isshown and described in detail, for example, in FIGS. 6A and 6B. Examplesof the plurality of image characteristics may include, but are notlimited to, a brightness, a contrast, a background color, a foregroundcolor, a saturation, a hue, and a gamma parameter.

At 810, a first region on display portion of the transparent display 106may be estimated for display of the text information associated with thereceived audio segment, based on the determined level of each imagecharacteristic from the plurality of image characteristics of thecaptured image. The circuitry 202 may be configured to estimate oridentify the first region based on the determined level of each imagecharacteristic from the plurality of image characteristics of thecaptured image. The estimation of the first region for the display ofthe text information is described in detail, for example, in FIGS. 5Aand 5B.

At 812, a level of each display characteristic from the set of displaycharacteristics for the text information may be determined based on theestimated first region and the determined level of each imagecharacteristic of the captured image. The circuitry 202 may beconfigured to determine the level of each display characteristic fromthe set of display characteristics for the text information associatedwith the audio content. The determination of the level of each displaycharacteristic is described in detail, for example, in FIGS. 5A and 5B.In accordance with an embodiment, the circuitry 202 may be configured toidentify a position of the received audio segment in the audio contentbased on lyrics information associated with the audio content. Thelyrics information associated with the audio content may be stored inthe memory, such as the memory 208. The circuitry 202 may be furtherconfigured to extract the text information associated with the receivedaudio segment from the stored lyrics information, based on theidentified position of the audio segment in the audio content.

At 814, display of the text information in the estimated first region ofthe display portion of the transparent display 106 may be controlled,based on the determined level of each display characteristic from theset of display characteristics. The circuitry 202 may be configured tocontrol the display text information in the estimated first region ofthe transparent display 106. The display of the text information in thefirst region is described in detail, for example, in FIGS. 5A and 5B.

At 816, playback of the received audio segment may be controlled via aspeaker. The circuitry 202 may be configured to control the playback ofthe received audio segment for the wearer 114 of the head-mounteddevice, via the speaker, such as the speaker 212A. The circuitry 202 maybe configured to control playback of the received audio segment via thespeaker 212A, along with the display of the text information associatedwith the audio segment on the transparent display 106 in real-time ornear real-time. The control may pass to end.

Exemplary aspects of the disclosure may include a head-mounted device(such as the head-mounted device 102) that includes a transparentdisplay (such as the transparent display 106). The head-mounted device102 may further include a first image capturing device (such as thefirst image capturing device 104) configured to capture an image of ascene in a line-of-sight (LOS) of a wearer (such as the wearer 114) ofthe head-mounted device 102. The head-mounted device 102 may furtherinclude circuitry (such as the circuitry 202) configured to receive anaudio segment that corresponds to audio content. The circuitry 202 maybe configured to determine a level of each image characteristic from aplurality of image characteristics of a background portion and aforeground portion of the captured image. The plurality of imagecharacteristics may correspond to ambient lighting conditions. Thecircuitry 202 may be further configured to estimate a first region on adisplay portion of the transparent display for display of textinformation associated with the received audio segment. The first regionmay be estimated based on the determined level of each imagecharacteristic from the plurality of image characteristics.

The circuitry 202 may be further configured to determine a level of eachdisplay characteristic from a set of display characteristics for thetext information based on the estimated first region and the determinedlevel of each image characteristic from the plurality of imagecharacteristics. The circuitry 202 may be further configured to controlthe display of the text information in the estimated first region of thedisplay portion of the transparent display, based on the determinedlevel of each display characteristic from the set of displaycharacteristics.

In accordance with an embodiment, the head-mounted device 102 mayfurther include a second image capturing device (such as the secondimage capturing device 204) configured to track an eye movement of thewearer 114. The circuitry 202 may be further configured to determine theLOS of the wearer 114 based on the tracked eye movement of the wearer114. The head-mounted device 102 may further include an orientationsensor (such as the orientation sensor 206) configured to determine anorientation of the head-mounted device 102 in a worn state of thehead-mounted device 102. The circuitry may be further configured todetermine the LOS of the wearer 114 based on the determined orientationof the head-mounted device 102.

The plurality of image characteristics may include a brightness, acontrast, a background color, a foreground color, a saturation, a hue,and a gamma parameter of the captured image. The determined level ofeach display characteristic from the set of display characteristics ofthe text information may be in contrast with the determined level ofeach image characteristic from the plurality of image characteristics.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to partition the captured image into a plurality of imageregions. The circuitry 202 may be further configured to estimate abrightness level for each of the plurality of image regions. Thecircuitry 202 may be further configured to determine a first imageregion from the plurality of image regions based on a brightness levelfor each of the plurality of image regions. The first image region maycorrespond to the estimated first region on the display portion. Thecircuitry 202 may be further configured to control the display of thetext information within the determined first region of the displayportion of the transparent display, based on the determined first imageregion. In accordance with an embodiment, the brightness level of thedetermined first image region may be maximum among the brightness levelfor each of the plurality of image regions.

In accordance with an embodiment, the estimation of the first region onthe display portion of the transparent display for the display of thetext information may be further based on the LOS of the wearer 114. Thedisplay of the text information within the estimated first region of thedisplay portion of the transparent display may be further based on theLOS of the wearer 114.

In accordance with an embodiment, the head-mounted device 102 mayfurther include a memory (such as the memory 208) configured to storelyrics information associated with the audio content. The circuitry 202may be further configured to identify a position of the received audiosegment in the audio content based on the stored lyrics information. Thecircuitry 202 may be further configured to extract the text informationfrom the stored lyrics information, based on the identified position.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to select, from a plurality of display characteristics, theset of display characteristics for the text information. Thedetermination of the level of each display characteristic from the setof display characteristics may be further based on a user-input. Theplurality of display characteristics may include a foreground color, abackground color, a contrast, and a brightness for the text informationdisplayed on the display portion of the transparent display. Inaccordance with an embodiment, the text information may be displayedwithin the first region without an overlap with a see-throughregion-of-interest in the display portion of the transparent display, inthe worn state of the head-mounted device 102.

In accordance with an embodiment, the circuitry 202 may be furtherconfigured to control display of an enhanced view of an object from oneor more objects in the foreground portion of the captured image. Thedisplay of the enhanced view of the object may be controlled on thedisplay portion of the transparent display, based on a user selection ofthe object. The circuitry 202 may be further configured to determine thelevel of each image characteristic of the plurality of imagecharacteristics associated with the enhanced view of the object. Thecircuitry 202 may be further configured to determine the level of eachdisplay characteristic from the set of display characteristics for thetext information, based on the determined level of each imagecharacteristic from the plurality of image characteristics for theenhanced view. The circuitry 202 may be further configured to controlplayback of the received audio segment via a speaker (such as thespeaker 212A).

Various embodiments of the disclosure may provide a non-transitory,computer-readable medium and/or storage medium, and/or a non-transitorymachine readable medium and/or storage medium stored thereon, a set ofinstructions executable by a machine and/or a computer for display ofinformation related to audio content based on ambient lightingconditions. The set of instructions may be executable by the machineand/or the computer to perform the steps that may comprise capture of animage of a scene in a line-of-sight (LOS) of a wearer of a head-mounteddevice. An audio segment may be received that corresponds to audiocontent. A level of each image characteristic from a plurality of imagecharacteristics of a background portion and a foreground portion of thecaptured image may be determined. The plurality of image characteristicsmay correspond to ambient lighting conditions. A first region may beestimated on a display portion of the transparent display for display oftext information associated with the received audio segment, based onthe determined level of each image characteristic from the plurality ofimage characteristics. A level of each display characteristic from a setof display characteristics may be determined for the text informationbased on the estimated first region and the determined level of eachimage characteristic from the plurality of image characteristics. Thedisplay of the text information may be controlled in the estimated firstregion of the display portion of the transparent display, based on thedetermined level of each display characteristic from the set of displaycharacteristics

The present disclosure may be realized in hardware, or a combination ofhardware and software. The present disclosure may be realized in acentralized fashion, in at least one computer system, or in adistributed fashion, where different elements may be spread acrossseveral interconnected computer systems. A computer system or otherapparatus adapted to carry out the methods described herein may besuited. A combination of hardware and software may be a general-purposecomputer system with a computer program that, when loaded and executed,may control the computer system such that it carries out the methodsdescribed herein. The present disclosure may be realized in hardwarethat comprises a portion of an integrated circuit that also performsother functions.

The present disclosure may also be embedded in a computer programproduct, which comprises all the features that enable the implementationof the methods described herein, and which when loaded in a computersystem is able to carry out these methods. Computer program, in thepresent context, means any expression, in any language, code ornotation, of a set of instructions intended to cause a system withinformation processing capability to perform a particular functioneither directly, or after either or both of the following: a) conversionto another language, code or notation; b) reproduction in a differentmaterial form.

While the present disclosure is described with reference to certainembodiments, it will be understood by those skilled in the art thatvarious changes may be made and equivalents may be substituted withoutdeparture from the scope of the present disclosure. In addition, manymodifications may be made to adapt a particular situation or material tothe teachings of the present disclosure without departure from itsscope. Therefore, it is intended that the present disclosure not belimited to the particular embodiment disclosed, but that the presentdisclosure will include all embodiments that fall within the scope ofthe appended claims.

What is claimed is:
 1. A head-mounted device, comprising: a transparent display; a first image capturing device configured to capture an image of a scene in a line-of-sight (LOS) of a wearer of the head-mounted device; and circuitry configured to: receive an audio segment that corresponds to audio content; partition the captured image into a plurality of image regions; determine a level of each image characteristic from a plurality of image characteristics of a background portion and a foreground portion of each of the plurality of image regions of the captured image, wherein the plurality of image characteristics corresponds to ambient lighting conditions, and the plurality of image characteristics includes a brightness level of each of the plurality of image regions; compare the brightness level between the plurality of image regions; determine a first image region of the plurality of image regions based on a result of the comparison of the brightness level between the plurality of image regions; determine a first region on a display portion of the transparent display for display of text information associated with the received audio segment, based on the determined level of each image characteristic from the plurality of image characteristics, wherein the first region corresponds to the first image region of the plurality of image regions, and the brightness level of the first image region is maximum among the brightness level of each of the plurality of image regions; determine a level of each display characteristic from a set of display characteristics for the text information based on the determined first region and the determined level of each image characteristic from the plurality of image characteristics; and control the display of the text information in the determined first region of the display portion of the transparent display, based on the determined level of each display characteristic from the set of display characteristics.
 2. The head-mounted device according to claim 1, further comprising a second image capturing device configured to track an eye movement of the wearer, wherein the circuitry is further configured to determine the LOS of the wearer based on the tracked eye movement of the wearer.
 3. The head-mounted device according to claim 1, further comprising an orientation sensor configured to determine an orientation of the head-mounted device in a worn state of the head-mounted device, wherein the circuitry is further configured to determine the LOS of the wearer based on the determined orientation of the head-mounted device.
 4. The head-mounted device according to claim 1, wherein the plurality of image characteristics further comprises a contrast, a background color, a foreground color, a saturation, a hue, and a gamma parameter of the captured image.
 5. The head-mounted device according to claim 1, wherein the determined level of each display characteristic from the set of display characteristics of the text information is in contrast with the determined level of each image characteristic from the plurality of image characteristics.
 6. The head-mounted device according to claim 1, wherein the determination of the first region on the display portion of the transparent display for the display of the text information is further based on the LOS of the wearer.
 7. The head-mounted device according to claim 1, wherein the display of the text information within the determined first region of the display portion of the transparent display is further based on the LOS of the wearer.
 8. The head-mounted device according to claim 1, further comprising a memory configured to store lyrics information associated with the audio content, wherein the circuitry is further configured to: identify a position of the received audio segment in the audio content based on the stored lyrics information; and extract the text information from the stored lyrics information, based on the identified position.
 9. The head-mounted device according to claim 1, wherein the circuitry is further configured to: select, from a plurality of display characteristics, the set of display characteristics for the text information, wherein the determination of the level of each display characteristic from the set of display characteristics is further based on a user-input.
 10. The head-mounted device according to claim 9, wherein the plurality of display characteristics comprises a foreground color, a background color, a contrast, and a brightness for the text information displayed on the display portion of the transparent display.
 11. The head-mounted device according to claim 1, wherein, in a worn state of the head-mounted device, the text information is displayed within the first region without an overlap with a see-through region-of-interest in the display portion of the transparent display.
 12. The head-mounted device according to claim 1, wherein the circuitry is further configured to: control display of an enhanced view of an object, from one or more objects in the foreground portion of the captured image, on the display portion of the transparent display, based on a user selection of the object; determine the level of each image characteristic of the plurality of image characteristics associated with the enhanced view of the object; and determine the level of each display characteristic from the set of display characteristics for the text information, based on the determined level of each image characteristic from the plurality of image characteristics for the enhanced view.
 13. The head-mounted device according to claim 1, wherein the circuitry is further configured to control playback of the received audio segment via a speaker, and the playback of the received audio segment is in synchronization with the display of the text information in the first region of the display portion of the transparent display.
 14. The head-mounted device according to claim 1, wherein the circuitry is further configured to change the first region on the display portion to a second region on the display portion, for the display of the text information, based on a change in the LOS of the wearer from a first position to a second position, and the second region corresponds a second image region of the plurality of image regions.
 15. The head-mounted device according to claim 1, wherein the circuitry is further configured to change a display size of the text information based on a size of an area of the determined first region.
 16. A method, comprising: in a head-mounted device that comprises a transparent display, a first image capturing device, and circuitry: capturing, by the first image capturing device, an image of a scene in a line-of-sight (LOS) of a wearer of the head-mounted device; receiving, by the circuitry, an audio segment that corresponds to audio content; partitioning, by the circuitry, the captured image into a plurality of image regions; determining, by the circuitry, a level of each image characteristic from a plurality of image characteristics of a background portion and a foreground portion of each of the plurality of image regions of the captured image, wherein the plurality of image characteristics corresponds to ambient lighting conditions, and the plurality of image characteristics includes a brightness level of each of the plurality of image regions; comparing, by the circuitry, the brightness level between the plurality of image regions; determining, by the circuitry, a first image region of the plurality of image regions based on a result of the comparison of the brightness level between the plurality of image regions; determining, by the circuitry, a first region on a display portion of the transparent display for display of text information associated with the received audio segment, based on the determined level of each image characteristic from the plurality of image characteristics, wherein the first region corresponds to the first image region of the plurality of image regions, and the brightness level of the first image region is maximum among the brightness level of each of the plurality of image regions; determining, by the circuitry, a level of each display characteristic from a set of display characteristics for the text information based on the determined first region and the determined level of each image characteristic from the plurality of image characteristics; and controlling, by the circuitry, the display of the text information in the determined first region of the display portion of the transparent display, based on the determined level of each display characteristic from the set of display characteristics.
 17. The method according to claim 16, further comprising: tracking, by a second image capturing device, an eye movement of the wearer; and determining, by the circuitry, the LOS of the wearer based on the tracked eye movement of the wearer.
 18. The method according to claim 16, further comprising: determining an orientation of the head-mounted device in a worn state of the head-mounted device; and determining, by the circuitry, the LOS of the wearer based on the determined orientation of the head-mounted device.
 19. The method according to claim 16, wherein the determined level of each display characteristic from the set of display characteristics for the text information is in contrast with the determined level of each image characteristic from the plurality of image characteristics.
 20. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a head-mounted device that comprises a transparent display and an image capturing device, cause the head-mounted device to execute operations, the operations comprising: capturing, by the image capturing device, an image of a scene in a line-of-sight (LOS) of a wearer of the head-mounted device; receiving an audio segment that corresponds to audio content; partitioning the captured image into a plurality of image regions; determining a level of each image characteristic from a plurality of image characteristics of a background portion and a foreground portion for each of the plurality of image regions of the captured image, wherein the plurality of image characteristics corresponds to ambient lighting conditions, and the plurality of image characteristics includes a brightness level of each of the plurality of image regions; comparing the brightness level between the plurality of image regions; determining a first image region of the plurality of image regions based on a result of the comparison of the brightness level between the plurality of image regions; determining a first region on a display portion of the transparent display for display of text information associated with the received audio segment, based on the determined level of each image characteristic from the plurality of image characteristics, wherein the first region corresponds to the first image region of the plurality of image regions, and the brightness level of the first image region is maximum among the brightness level of each of the plurality of image regions; determining a level of each display characteristic from a set of display characteristics for the text information based on the determined first region and the determined level of each image characteristic from the plurality of image characteristics; and controlling the display of the text information in the determined first region of the display portion of the transparent display, based on the determined level of each display characteristic from the set of display characteristics. 